Human Activity Language: Grounding Concepts with a Linguistic Framework

نویسندگان

  • Gutemberg Guerra-Filho
  • Yiannis Aloimonos
چکیده

We have empirically discovered that the space of human actions has a linguistic framework. This is a sensory-motor space consisting of the evolution of the joint angles of the human body in movement. The space of human activity has its own phonemes, morphemes, and sentences. This has implications for conceptual grounding. We present a Human Activity Language (HAL) for symbolic non-arbitrary representation of visual and motor information. In phonology, we define atomic segments (kinetemes) that are used to compose human activity. We introduce the concept of a kinetological system and propose five basic properties for such a system: compactness, viewinvariance, reproducibility, selectivity, and reconstructivity. In morphology, we extend sequential language learning to incorporate associative learning with our parallel learning approach. Parallel learning solves the problem of overgeneralization and is effective in identifying the kinetemes and active joints in a particular action. In syntax, we suggest four lexical categories for our Human Activity Language (noun, verb, adjective, and adverb). These categories are combined into sentences through syntax for human movement.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Grounding Language in Descriptions of Scenes

The problem of how abstract symbols, such as those in systems of natural language, may be grounded in perceptual information presents a significant challenge to several areas of research. This paper presents the GLIDES model, a neural network architecture that shows how this symbol-grounding problem can be solved through learned relationships between simple visual scenes and linguistic descript...

متن کامل

Abstract Concepts Through the Lens of Linguistic and Extra-Linguistic Knowledge

The paper deals with the rigorous methods used in the research of concepts representing abstract notions like “friendship”, “love”, “hatred”, “conscience”, and “envy”. Concepts of that kind have no visible physical support in the material world except for the sound forms of the words representing them, thus causing additional difficulties in classification, research and analysis as well as stip...

متن کامل

Semiotic schemas: A framework for grounding language in action and perception

A theoretical framework for grounding language is introduced that provides a computational path from sensing and motor action to words and speech acts. The approach combines concepts from semiotics and schema theory to develop a holistic approach to linguistic meaning. Schemas serve as structured beliefs that are grounded in an agent’s physical environment through a causal-predictive cycle of a...

متن کامل

Natural Language Grounding and Grammar Induction for Robotic Manipulation Commands

We present a cognitively plausible system capable of acquiring knowledge in language and vision from pairs of short video clips and linguistic descriptions. The aim of this work is to teach a robot manipulator how to execute natural language commands by demonstration. This is achieved by first learning a set of visual ‘concepts’ that abstract the visual feature spaces into concepts that have hu...

متن کامل

Grounding Language in the World: Schema Theory Meets Semiotics

A theoretical framework for grounding language is introduced that provides a computational path from sensing and motor action to words and speech acts. The approach combines concepts from semiotics and schema theory to develop a holistic approach to linguistic meaning. Schemas serve as structured beliefs that are grounded in an agent’s physical environment through a causal-predictive cycle. Spe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006